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(54) Image coding nnethod and apparatus with code amount estimation 



(57) A coding apparatus has a quantizer selected 
from a quantizer group and being used for coding input- 
ted data, a first code amount calculation circuit for calcu- 
lating a code amount of codes of the Inputted data 
quantized by the quantizer, a prediction circuit for pre- 
dicting a quantizer among the quantizer group capable 
of obtaining a target code amount, in accordance with 
the code amount calculated by the first code amount cal- 
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culation circuit, the quantizer predicted by the prediction 
circuit for quantizing the inputted data, a second code 
amount calculation circuit for calculating a code amount 
of codes of the inputted data quantized by the predicted 
quantizer, and a comparator circuit for comparing tiie 
code amount calculated by tiie second code amount cal- 
culation circuit with the target code amount 
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Description 

The present invention relates to a coding apparatus and metliod in which a code length for length fixing is calculated 
during variable length coding. 

5 In a conventional method of highly efficiently coding image data, the inrage data is divided into a small block of i x 

i pixels, a small block is orthogonally transformed, (e.g.. two<iimensional disaete cosine transformation (DCT)), the 
orthogonally transformed coefficients are quantized while considering the human visual sense characteristics, and the 
quantized coefficients are transformed into a variable length code (e.g., a Huffman code which Is a con^ination of a run 
length of 0 coefficients and amplitudes of significant coefficients). 
10 In recording variable length coded data in a VTR or the like, k small tjlocks (k s 1 . integer) are cod^ so as to match 
a record or transmission rate, and the code amount after coding is controlled to be Rk or smaller. 
Fig. 1 shows a conventional coding apparatus which performs such a code amount control. 
In Fig. 1 , reference numeral 1300 represents an input terminal for image data to be orthogonally transformed, ref- 
erence numerals 1302o to 1302^-1 represent a table number of each quantization table or an input terminal for a quan- 
15 tization step, reference numeral 1 304 represents a FIFO for delaying input image data by a time required for determining 
a quantization table by which the irput image data is quantized. 

Reference numerals 1 306o to 1 306n.i represent a quantization drcurtfor quantizing orthogonally transformed image 
data, reference numerals 1308o to 1308^.1 represent a code length generation circuit for generating a code length of 
image data quantized and variable-length cod^, reference numerals 1310© to 1310^.1 represent an adder circuit for 
20 adding code lengths, and reference numerals 1312o to 1312^.1 represent a latch circuit for latching a code length added 
each time a code is generated. 

Reference numeral 1314 represents a selection circuit which selects, from N code amounts ol>tained through var- 
iable length coding of k small blocks by N quantization tables, the code amount nearest to a desired amount Rk. and 
outputs a corresponding quantization table or its quantization table nurrtoer n (0 ^ n ^ N-1) from an output terminal 
25 1318. Reference numeral 1316 represents an output terminal of delayed image data from FIFO 1304. 
The operation of the coding apparatus structured as above will be described. 

Image data is divided into small blocks. Each small fcrfock is orthogonally transformed (e.g.. two-dimensional DOT), 
and the transformed image data is applied to the input terminal 1 300. The quantization circuits 1 30&o to 1 306n.i divide 
two-dimensionally DCTed image data of each small block into M areas in the range from low to high frequencies, for 
30 example, as shown in Rg. 2, and quantize at a predetermined step size which becomes coarse from the area 0 to area 
N-1 toward the high frequency range while considering the human visual sense characteristics, for example, as shown 
in Fig. 3. 

The quantization circuit 1 306o is supplied with a quantization table Qo from the input terminal 1 302o, and quantizes 
DCTed image data of a small block, at a step size of 1 /1 6 for the area 0. 1 /1 6 for the area 1 and 1 /64 for the area M- 

35 1 , in accordance with the quantization table Qq. The image data of the small block quantized by the quantization circuit 
1 306o using the quantization table Qo is supplied to the code length generation circuit 1 308o- The code length generation 
circuit 1308o generates a code length of a variable length code suitable for the quantized image data and supplies it to 
the adder circuit 1 3 1 Oq. The variable length code is. for example, a two-dimensional Huffman code which is a combination 
of a run length of 0 values of quantized image data and significant values. 

40 The adder drcuit 131 Go is supplied with a code length from the code length generation circuit 1308o and with a 
cumulative value of past code lengths from the latch circuit 1312o. and adds the two values, the result being supplied 
to the latch circuit 1312o. The latch circuit 1312o latches the added value from the adder circuit 1310o and supplies it to 
the adder circuit 1310o and also to the selection circuit 1314. The value latched in the latch circuit 1312o is reset to "0" 
each time a set of k small blocks as the length fixing unit has been processed. 

45 Similar to the above, the quantization circuits 1306i to 1306jg.i quantize orthogonally transformed image data by 
using quantization tables Qi to Qn-i. ^d the code length generation circuits 1308i to 1308rv|.i, adder circuits 1310i to 
1310n.v and latch circuits 1312i to 1312^-1 operate in the similar manner as above for the quantized image data. Each 
latch circuit 1 31 2i to 1 31 2^.1 is reset to "0" at a similar timing in the unit of k small blocks. In this manner, the latch circuit 
1312o to 1312^.1 calculate code amounts RQo to RQzn-i oi codes of the orthogonally transformed k small blocks quan- 

50 tized by using the quantization tables Qo to Q^^.^. 

The selection circuit 1314 is supplied with N code amounts RQo, RQi..-.. RQn-i to'' each set of k small blocks from 

the latch circuits 1312o. 1312i 1312^.^. The selection circuit 1314 selects, from these N code amounts, the largest 

RQn satisfying Rqn s Rk which is determined to be the code amount of the fixed length code, and outputs a corresponding 
quantization table Qn or its quantization table number n (0 ^ n ^ N-1) from the output terminal 1318. FIFO 1304 delays 

55 orthogonally transformed image data by a time required for the selection circuit 1 314 to determine the quantization table- 
After the quantization table is determined, a circuit (not shown) quantizes the image data delayed by FIFO 1 304 by 
using the determined quantization table Qn and codes the quantized image data into variable length codes to obtain 
desired codes. 
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With the above conventional coding apparatus, however, in order to compress k small blocks into a desired code 
amount Rk or smaller, N quantization circuits and N code amount calculating circuits corresponding in number to N 
quantization tables are required. The coding apparatus has therefore a bulky amount of hardware. 

Since k small blocks are quantized by using the same quantization table Qp, the code amount Rqn after length fixing 
5 becomes too small depending upon image data, and a difference Rk - Rqn ^orn the target code amount Rk becomes 
too large. Therefore, an empty area is generated in a record or transmission area, which is not efficient and an image 
is degraded. 

It is a first object of one embodiment of the present invention to provide a coding apparatus capable of fixing a length 
of a code amount with less hardware. 

10 It is an object of another embodiment of the present invention to provide a coding apparatus capable of efficiently 
using a record or transmission area by reducing an empty area and capable of improving an image quality, by reducing 
a difference Rk - Rqn ^rom the target code amount Rk as much as possible. 

According to af irst embodiment of the invention, a coding apparatus comprises: a quantizer selected from a quantizer 
group and being used for coding inputted data; a first code amount calculation means for calculating a code amount of 

15 codes of the inputted data quantized by the quantizer; a prediction means for predicting a quantizer among the quantizer 
group capable of obtaining a target code amount, in accordance with the code amount calculated by the first code amount 
calculation means; the quantizer predicted by the prediction means for quantizing the inputted data; a second code 
amount calculation means for calculating a code amount of codes of the inputted data quantized by the predicted quan- 
tizer; and a comparator means for comparing the code amount calculated by the second code amount calculation means 

20 with the target code amount. 

According to a second embodiment of the invention, a coding apparatus comprises: a quantizer selected from a 
quantizer group and being used for coding inputted data; a first code amount calculation means for calculating a code 
amount of codes of the inputted data quantized by the quantizer; a first prediction means for predicting a first quantizer 
among the quantizer group capable of obtaining a target code amount. In accordance with the code amount calculated 

25 by the first code amount calculation means; the first quantizer predicted by the first prediction means for quantizing the 
inputted data; a second code amount calculation means for calculating a code amount of codes of the inputted data 
quantized by the first quantizer; and a second prediction means for predicting a second quantizer among the quantizer 
group capable of obtaining the target code amount in accordance with the code amount calculated by the second code 
amount calculation means. 

30 In the first embodiment, quantization is performed by using a quantizer selected from a quantizer group, its code 
amount is calculated by the first code amount calculation means, a quantizer capable of obtaining the target code amount 
is predicted in accordance with the code amount, quantization is further performed by using the predicted quantizer, its 
code amount is calculated by the second code amount calculating means, and the calculated code amount and the 
target code amount are compared by the comparator means. In accordance with the comparison result, a quantizer 

35 used for length fixing Is decided. 

According to the second embodiment, quantization is performed by using a quantizer selected from a quantizer 
group, its code amount is calculated by the first code amount calculation means, a first quantizer capable of obtaining 
the target code amount is predicted in accordance with the code amount, quantization is further performed by using the 
first quantizer, its code amount is calculated by the second code amount calculating means, and the second quantizer 

40 used for length fixing is decided. 

Embodiments of the present invention will now be described with reference to the accompanying drawings In which: 

Fig. 1 is a block diagram showing a conventional coding apparatus. 

Fig. 2 is a diagrarn illustrating an area of each quantization step used for quantizing orthogonally transformed (two- 
45 dimensional DCT) image data. 

Fig. 3 is a table illustrating examples of st^ sizes used by a quantization circuit. 

Fig. 4 is a block diagram illustrating a first embodiment of the invention. 

Fig. 5 is a graph showing statistical values obtained by a quantization circuit. 

Fig. 6 is a block diagram illustrating a second embodiment of the invention. 
so Fig. 7 is a graph showing statistical values obtained by a quantization circuit. 

Figs. 8A to 8D are diagrams illustrating division of a quantization circuit group. 

Fig. 9 is a block diagram Illustrating a third embodiment of the invention. 

Fig. 10 is a diagram showing the relationship between a length fixing unit and an adaptive quantization circuit unit. 
Fig. 1 1 is a block diagram showing a modification of the third embodiment of the invention. 
55 Fig. 12 is a block diagram illustrating a fourtii embodiment of tiie invention. 

Fig. 13 is a block diagram showing a modification of the fourth embodiment of the invention. 

Fig. 4 is a block diagram showing the first embodiment of the invention. In Rg. 4. reference numeral 1 00 represents 
an input terminal for image data orthogonally transformed (e.g., two-dimensional DCT). Reference numeral 102 repre- 
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sents an input terminal for a quantization table number (or quantization step size). Reference numeral 104 represents 
an input terminal for a mode signal (high definition image or standard definition image) of inputted image data. Reference 
numeral 106 represents a quantization circuit for quantizing orthogonally transformed image data. Reference numeral 
108 represents a FIFO for delaying orthogonally transformed image data. Reference numeral 110 represents a code 

5 length generation circuit for generating a code length of variable length code of the quantized image data (for example, 
a two-dimensional Huffman code which is a combination of a run length of 0 data and a value of signrftcant data). 
Reference numeral 1 1 2 represents an adder circuit for cumulatively adding a code length each time a code is generated. 
Reference numeral 114 represents a latch circuit for latching a cumulative code length. Reference numeral 1 16 repre- 
sents a comparator circuit for comparing a quantization table prediction threshold value and a cumulative code length. 

10 Reference numeral 1 1 8 represents a counter circuit which counts down its value when the comparator circuit 116 detects 
that the cumulative value is in excess of the prediction threshold value. Reference numeral 1 20 represents a quantization 
table prediction value generation circuit for generating a quantization table prediction threshold value in accordance with 
the count of the counter circuit 118 and the mode signal. Reference numeral 122 represents a latch circuit for latching 
the predicted quantization table number. 

15 Reference numerals 124, 126, and 128 represent Input/output terminals for FIFO 108, latch circuit 122, and mode 

signal. Reference numeral 130 represents a quantization circuit similar to the quantization circuit 106 for quantizing 
orthogonally transformed image data. Reference numeral 1 32 r^resents a FIFO similar to FIF0 1 08 for delaying orthog- 
onally transformed image data. Reference numeral 134 represents a variable length code generation circuit which oper- 
ates in the similar manner to the code length generation ciroiit 1 1 0. Reference numeral 1 36 represents an adder cirojit 

20 similar to the adder circuit 1 1 2 for cumulatively adding a code length. Reference numeral 1 38 represents a latch circuit 
similar to the latch circuit 1 14 for latching the cumulative code length. Reference numeral 140 represents a latch circuit 
for latching the cumulative code length for each length fixing unit (k small blocks). Reference numeral 142 represents a 
comparator circuit for comparing the cumulative code length with a target code amount Rk- Reference numeral 144 
represents an input terminal for the target code amount R^- Reference numerals 148, 150. 154, and 156 represent 

25 output terminals for FIFO 132, comparator circuit 142, latch circuit 122. and mode signal of high definition (HD) or 
standard definition (SD). 

Next, the operation of the coding apparatus constructed as above will be described. 

Image data orthogonally transformed (two<limensional DCT) for each small block is applied to the input terminal 
and supplied to the quantization circuit 1 06 and FIF0 1 08. The quantization circuit 1 06 is supplied with one quantization 

30 table Qp (0 ^ p ^ N-1 , e.g., p = N/2 ) among those quantization tables shown in Figs. 8A to 8D, quantizes the orthogonally 
transformed image data in accordance with the supplied quantization table Qp. and supplies the results to the code 
length generation circuit 110. The code length generation circuit 1 10 generates a code length of variable length code 
(two-dimensional Huffman code) assigned in accordance with the quantized image data supplied from the quantization 
circuit 106. and supplies it to the adder circuit 112. The adder circuit 112 adds the code length supplied from the code 

35 length generation circuit 1 1 0 to the cumulative value of past code lengths supplied from the latch circuit 1 1 4, and supplies 
the added result to the latch circuit 1 14. The latch circuit 1 14 latches the added result supplied from the adder circuit 
1 1 2, and supplies it to the comparator circuit 1 1 6 and adder circuit 112. The latch circuit 114 resets the latched value 
to "0" for each set of k small blocks which is a length fixing unit. The comparator circuit 1 16 compares the cumulative 
value of code lengths supplied from the latch circuit 1 14 with the value supplied from the quantization table prediction 

40 threshold value generation circuit 120. 

The prediction threshold value supplied from the quantization table prediction threshold value generation circuit 120 
will be described. Image data of k small blocks is quantized by the quantization table Qp. arxl its code amount IQp is 
calculated. At the same time, a quantization table Qp for fixed length is also calculated, this quantization table On having 
a maximum code amount RQ^ satisfying R ^ R^ where Rk is a target code amount and R is a coded code amount. A 

45 quantization table Q'^ corresponding to the target code amount Rk is obtained through interpolation of RQp and ROn+i • 
(IQp, Q'n) values for various image data calculated in the above manner have a high congelation as shown in Rg. 5, 
and can be approximated to a curve Q'n = ^'Qp) ■ using the curve Q'n = ^('Qp) shown in Fig. 5, the quantization 
table Qn adaptive to lengtii fixing is predicted in accordance with the code amount IQp obtained by quantizing image 
data of k small tslocks by using tiie quantization table Qp. If tine code amount is Sp(N.i) or smaller, a quantization table 

so Q^.^ is predicated,..., and if the code amount is Sp^r^.2) or smaller, a quantization table Q^-z is predicated. In this manner, 
a quantization table adaptive to length fixing is predicted. 

When the first block of k small blocks of the length fixing unit starts to be processed by the quantization circuit 1 06. 
the latch circuit 1 14 is reset to "0" and the counter circuit 1 18 is set to a count N-1. Upon reception of a value N-1 from 
the counter circuit 1 1 8. ^e quantization table prediction threshold value generation circuit 1 20 supplies first a prediction 

55 threshold value Sp(|sj.i) to the comparator circuit 116. The comparator circuit 116 compares the prediction threshold 
value Sp(N.i) with tiie ojmulative code lengtii sequentially si^plied from the latch circuit 1 14. If tiie cumulative value is 
Sp(N-i) or smaller, a low level signal is supplied to the counter circuit 118. and if the cumulative value is in excess of Sp^^. 
1), a high level signal is supplied to the counter circuit 1 18. 
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If the signal supplied from the comparator circuit 1 16 is the high level signal, the counter circuit 118 counts down 
its count to N-2. and supplies it to the quantization table prediction threshold value generation circuit 1 20. Upon reception 
of this value N-2. the circuit 1 20 supplies the next prediction threshold value Sp(N.2) to the comparator circuit 1 1 6. Then, 
the comparator circuit 1 16 compares the cumulative value with Sp(M.2)' this manner, the comparator circuit 116 com- 

5 pares the cumulative code amount supplied from the latch circuit 1 14 with the prediction threshold value supplied from 
the quantization table prediction threshold value generation circuit 1 20, and outputs the low level signal if the cumulative 
value is the prediction threshold value or smaller, and the high level signal if it is in excess of the prediction threshold 
value, respectively to the counter circuit 1 1 8. If the low level signal is supplied from the comparator circuit 1 1 6. the counter 
circuit 1 1 8 holds the present counter value, and if the high level signal is supplied. It decrements by -1 (count down) and 

10 supplies the result to the quantization table threshold value generation circuit 120. Then, this circuit 120 generates the 
prediction threshold value corresponding to the count supplied from the counter circuit 118, and supplies it to the com- 
parator circuit 1 1 6. 

After the image data of k-th small block is processed, the count n held In the counter circuit 1 18 represents the 
number of the predicted quantization table Qp. When the image data of k small blocks is processed, the latch circuit 1 22 

15 latches the output value n of the counter circuit 118. and supplies it to the quantization circuit 1 30. FIFO 1 08 delays the 
orthogonally transformed image data by a time required for processing k small blocks. Thereafter, the latch circuit 114 
and counter circuit 1 18 are again initialized to start processing the next k small blocks. 

Upon reception of the image data delayed by FIFO 108, the quantization circuit 130 quantizes the image data by 
using the quantization table Qp corresponding to the output value n of the latch circuit 122, and supplies the quantized 

20 image data to the code length generation circuit 1 34. Similar to the code length generation circuit 1 10, the code length 
generation circuit 134 generates a code length of a variable length encoded code (e.g. two-dimensional Huffman code) 
of the quantized image data, and supplies it to the adder circuit 136. Similar to the adder circuit 112, the adder circuit 
1 36 adds the output value of the code length generation circuit 1 34 to the value supplied from the latch circuit 1 38. and 
supplies the add«j result to the latch circuit 138. The latch circuit 138 latches the added value supplied from the adder 

25 circuit 136, and supplies it to the adder circuit 136. The latch circuit 138 as well as the latch circuit 1 14 is reset to "0" 
when the first small block among k small blocks as the length fixing unit starts to be processed. 

When the k small blocks as the length fixing unit are processed, the cumulative value RGp of code lengths latched 
in the latch circuit 138 is latched by the latch circuit 140 which in turn outputs it to the comparator circuit 142. The 
cumulative value RQn is a code amount of the image data of k small blocks quantized by the predicated quantization 

30 table Qp and coded through length fixing. The comparator circuit 142 compares the cumulative code amount RQn sup- 
plied from the latch circuit 140 with the target code amount Rk supplied from the input terminal 144. and outputs a low 
Iwel signal if RQp g Rk and the high level signal if RQp ^ Rk. respectively from the output terminal 150. 

FIF0 1 32 delays the orthogonally transformed (twcxJimensional DCT) image data by a time required for processing 
k small blocks, and outputs it from the output terminal 148. Outputted from the output terminal 154 is the number n 

35 corresponding to the predicted quantization table Qp to be used for length fixing and supplied from the latch circuit 1 22. 
Inputted from the input terminal 1 04 is a mode signal indicating whether the inputted Image data is for a high definition 
image (HD) or a standard definition image (SD). This mode signal Is supplied to the quantization circuits 106 and 130 
and quantization table prediction threshold value generation circuit 120. The quantization circuits 106 and 130 select 
either the quantization table for the high definition image (HD) or the quantization table for the standard definition image 

40 (SD) in accordance with the mode signal supplied from the input terminal 1 04. Similarly, the quantization tatjie prediction 
threshold value generation circuit 120 selects either the quantization table for the high definition Image (HD) or the 
quantization table for the standard def inrtion image (SD) in accordance with the mode signal supplied from the input 
terminal 104. The image data quantized by the quantization circuit 130 may be supplied to a succeeding stage coding 
circuit (not shown) to code it into a variable length code (e.g., two-dimensional Huffman code). 

45 According to the embodiment described above, inputted orthogonally transformed (two-dimensional DCT) Image 
data is quantized by one quantization table Qp among those quantization tables, the code amount RQp of variable length 
code is calculated, and a quantization table Qp adaptive to length fixing is predicted from the code amount RQp. Next, 
the orthogonally transformed image data is quantized by using the predicated quantization table Qp to confirm whether 
the target code amount Rk is satisfied. Accordingly, the amount of hardware can be reduced considerably as compared 

so to the conventional apparatus shown in Fig. 1 . 

In addition, the high definition image (HD) and standard definition image (SD) mode signals are provided to select 
corresponding ones of the quantization table and threshold value. Accordingly, the coding apparatus of this embodiment 
can be us^ for both the high definition image (HD) and standard definition image (SD). 

Fig. 6 is a block diagram illustrating the second emlDodiment of this invention. Elements having similar functions to 

55 tilose of the first embodiment of Fig 4 are represented by identical reference numerals. Only different points from tfie 
first embodiment will be described. 

Referring to Fig. 6. the latch circuit 138 sequentially supplies tiie cumulative code length of image data quantized 
by a quantization table predicted as described above and coded in variable length (e.g., two-dimensional Huffman code), 
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to the comparator circuit 200 which compares the cumulative code length with the prediction threshold value supplied 
from a quantization table prediction threshold value generation circuit 204. 

Next, three types of the operation of thjS quantization table prediction threshold value generation circuit 204 will be 
described. 

5 

(1) The counter circuit 202 sets its count to N-1 and supplies it to the quantization table prediction threshold value 
generation circuit 204, when the preceding circuit B completes the process of k small blocks as the length fixing 
unit, when the latch circuit 1 22 latches the number n corresponding to the predicted quantization table Qn and output 
it, and when the quantization circuit 130 starts processing of the k small blocte delayed by FIFO 108 by using the 

10 quantization table Qn- The quantization table prediction threshold value generation circuit 204 is supplied with the 
output value n of the latch circuit 122 and the count N-1 from the counter circuit 202, and generates a prediction 
threshold value Sn(N-i) which is supplied to the comparator circxiit 200. 

The quantization table prediction threshold value generation circuit 204 stores, as shown in Fig. 7. prediction 
threshold values Sno. Sni Sn(N-i)(n=0. 1,..., N-1)for each of the quantization tables Qo, Qi Qn-l generates 

75 a p-ediction threshold value Spn* accordance with a count n' (n' = 0, 1 N-1) and the output value n (n = 0. 1 

N-1) of the counter 202, and outputs the value Sm* to the comparator 200. The comparator circuit 200 operates in 
the similar manner to the comparator circuit 1 1 6 of the first embodiment. If the comparator circuit 1 1 6 outputs a low 
level signal, the counter circuit 202 holds its present count, and if the comparator circuit 116 outputs a high level 
signal, the counter circuit 202 decrements by -1 (count down) and supplies the result to the quantization table 

20 prediction threshold value generation circuit 204. 

When the k small blocks as the length fixing unit are processed, the latch circuit 206 latches the count n* of the 
counter circuit 202 and outputs it from the output terminal 208. This value n' indicates the quantization tat»le Qn* 
used for length fixing. 

(2) In the exanple (1), the quantization table prediction threshold value generation circuit 204 stores the prediction 
25 threshold values Sno, Spi . ... Sn(N-i) (n = 0, 1 N-1) for each of tiie quantization tables Qq. Qi. -. Qn-i ■ However. 

since the first prediction has already been performed by the preceding circuit B. the prediction threshold values may 

be. as shown in Fig. 10. Sn(n+u) Sn(n+i). Snn. Sn(n.i) Sn(n-v) relative to the predicted value n. For example, u = 

2 and V = 2, or other values. In this case, the counter circuit 202 sets not a value N-1 but a value n+u in accordance 
with the value n supplied from the latch circuit 1 22. In tiiis manner, tiie amount of hardware of the quantization table 
30 prediction threshold value generation circuit 204 can be reduced. 

(3) In the examples (1) and (2). the quantization table prediction threshold value generation circuit 204 stores the 

prediction threshold values for each of the quantization tables Qo. Qi Qn-i shown in Rg. 8A. In the example 

(3). if the latch circuit 122 outputs N-7 as the first prediction result the quantization table prediction tiireshold value 
generation circuit 204 is adapted to generate, for example as shown in Fig. 8C, a prediction threshold value by using 

35 the quantization table 0^.6- Specifically, the prediction threshold value is generated by Qn.2 if the output n of the 
latch circuit 122 is N-4 ^ n s N-1 by Qf^s output n is N-8 g n s N-5...., and by Q2 if the output n is 0 ^ n ^ 3. 
In this manner, the amount of hardware of tiie quantization table prediction threshold value generation circuit 204 
can be further reduced. Division of quantization tables may be such as shown in Figs. 8B and 8D in addition to Fig. 8C. 

40 Similar to tiie first embodiment, the quantization table prediction threshold value generation circuit 204 selects tiie 
prediction tiireshold value for either the quantization table for the high definition image (HD) or the quantization table for 
the standard definition image (SD), in accordance with the high definition (HD) image mode signal or standard definition 
(SD) image mode signal supplied from the input terminal 104. 

According to this embodiment, in accordance with the first prediction value n obtained by the first quantization table, 

45 the second quantization table is predicted. Accordingly, the quantization table n* more adaptive to the precise length 
fixing can be predicted. 

Fig. 9 is a block diagram illustrating tiie third embodiment of this invention. Elements having similar functions to 
those of the first and second emtjodiments of Figs. 4 and 6 are represented by identical reference numerals. Only different 
points from the first and second enrtbodiments will be described. 

50 Referring to Fig. 9. a quantization circuit 300 quantizes orthogonally transformed (two-dimensional DCT) image 
data delayed by FIFO 132 by using the quantization table Q^- in accordance with the value n' indicating the predicted 
quantization table and supplied from the latch circuit 206. The quantized image data is supplied to a code length gen- 
eration circuit 304 which similar to the code length generation circuits 110 and 134, generates a code length of variable 
length code (two-dimensional Huffman code) adaptive to ttie quantized image data, and supplies it to adder circuits 306 

55 and 320. The adder circuit 306 adds the code length supplied from the code length generation circuit 304 to the cumulative 
value supplied from a latch drcuit 308. and supplies the added result to the latch circuit 308. 

The latch circuit 308 latches tiie added result supplied from the adder circuit 306, and supplies it to the adder circuits 
306 and 316. Similar to the latch circuits 114 and 138. the latch circuit 308 is reset to "0" each time tiie k small blocks 
as the lengtii fixing unit are processed. Therefore, after tiie k small blocks as tiie lengtii fixing unit are processed, ttie 
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latch circuit 8 latches the code amount RQp of the k small blocks quantized by the predicted quantization table Q^- and 
coded in length fixing. The code amount RQn' of the k small blocks latched by the latch circuit 308 is supplied to a 
comparator 310 which is also supplied with the target code amount Rk via an input terminal 314. !f RQn- ^ Rk. the 
comparator circuit 310 outputs "0" (low level signal), and if RQn- > Rk. the comparator circuit 310 outputs "1 " (high level 

5 signal), respectively to a latch circuit 312. The latch circuit 312 latches the comparison result signal of the comparator 
circuit 310. In other words, the latch circuit 31 2 latches a signal indicating whether the code amount is within the target 
code amount or is overflowed. An output of the latch circuit 308 is also supplied to the adder circuit 316. 

The adder circuit 316 outputs a difference between the output of the latch circuit 308 and the target code amount 
Rk supplied via the input terminal 314. The latch circuit 318 latches and outputs a difference def Qj,. = Rk - RQn' 

10 between the target code amount Rk outputted from the adder circuit 316 and the code amount RQp* of the image data 
quantized by the quantization table Qn* and coded in length fixing. An adder circuit 320 adds the code length generated 
from the code length generation circuit 304 to the cumulative value supplied from a latch circuit 322, and supplies the 
added value to the latch circuit 322. 

In transmitting or recording coded data, it becomes necessary for the decoding side to know what quantization table 

IS was used at the coding side. Therefore, the quantization table used for quantization is transmitted or recorded together 
with the coded data by any one of transmission or recording methods. Assuming that as shown in Fig. 10. image data 
is sent in the h small block unit (1 ^ h ^ k, where h is a divisor of k), then the latch circuit 322 is reset to "0" each time 
h small blocks (each a point shown in Fig. 10) are processed during the processing period of the k small blocks as the 
length fixing unit In other words, the latch circuit 322 outputs the code amount RQny (0 ^ r ^ k/(h-1 )) every h small blocks. 

20 A FIFO 324 receives a value of the latch circuit 322 before it is reset to "0". i.e.. receives the code amount RQn r 
(code amount for h small blocks) at the b point shown in Fig. 10. Namely. FIFO 324 receives a value for k/h small blocks 
during the process period of the k small blocks as the length fixing unit. A FIFO 302 delays the orthogonally transformed 
(two<limensional DCT) image data by a time required for the above processes. 

Next, in accordance with the value n' indicating the predicted quantization table and supplied from the latch circuit 

25 206 and with the output signal of the latch circuit 312, a quantization circuit 338 quantizes the delayed image data 
supplied from FIFO 302, t>y selecting the quantization table Qnvi having a smaller quantization step than the quantization 
table Qn* if tiie signal of tiie latch circuit 312 is "0" (low level signal) and by selecting the quantization table Qn-.i having 
a larger quantization step than the quantization table Qn* if the signal of tiie latch circuit 312 is "r (high level signal). 
After tiie delayed image data is quantized by the quantization circuit 338, it is supplied to a code length generation circuit 

30 342. Similar to the code length generation circuits 110, 134. and 304. the code lengtii generation circuit 342 generates 
a code length of variable length code, and supplies it to an adder circuit 344. 

The adder circuit 344 adds the code length supplied from the code length generation circuit 342 to the cumulative 
code length supplied from a latch circuit 346, and supplies the added value to tiie latch circuit 346. The latch circuit 346 
latches the output of the adder circuit 344, and outputs it to the adders 344, 348, and 352. Similar to the latch circuit 

35 322, tiie latch drcuit 346 is reset to "0" each time h (1 ^ h ^ k) small blocks are processed during the process period of 
the k small blocks as the length fixing unit At the timing when tiie latch circuit 346 latches the code amount RQ(nvi)r (0 
s r ^ k^(h-l)) if the output of the latch circuit 312 is "0" or the code amount RQ(n--i)r <^ the output of the latch circuit 312 
is T, tiie code amount RQny is read from FIFO 324 to calculate a difference of RQ(n'+i)r - RQn r RQ{n-i)r -RQn'r) at 
tiie adder circuit 352. A latch circuit 354 latches the calculated difference of RQ(n+i)r " RQnv (or RQ(n'.i)r * RQn r). and 

40 supplies it to a FIFO 356 which loads it in. Next, the operation of tNs encoding apparatus will be described for the cases 
where the output of the latch circuit 312 is "0" or "1". 

(1) When the output of tiie latch circuit 312 is "0" (low level), a switch 364 selects a terminal b to supply an output 
def = Rk • RQn* of the latch circuit 318 to a latch circuit 362. The latch circuit 362 loads def Q^-. After tiie 

45 calculation of a code lengtii of the image data of the k smalt blocks is completed and the k/h values RQ(nvi )o * RQn O' 

RQ(n'+i)i - RQn'i RQ(n+i)(k/(h-i)) ' RQn'(k/(h-i)) 'o^ded in FIFO 356, first RQ(n+i)o • RQn'O 's read from FIFO 

356 and outputted to an adder circuit 358. The adder circuit 358 subtracts RQ(n*+i)o - RQnO ^om the output def On* 
of the latch circuit 362. and supplies the result def Qn- - (RQ(n+i)0 -RQno) to a terminal a of the switch 360 and to 
a quantization table decision circuit 366. 

so The quantization table decision circuit 366 decides the quantization table 0^,*^^ for the h small blocks in this 

section (Aq section in Fig. 10) if tiie output def Q^- - (RQ(nvi)o ■ RQn o) 's "0" or larger, and controls to select tiie 
terminal a of tiie switch 360. The latch circuit 362 latches the output def Qp- - (RQ(n +i)0 - RQno) and supplies it to 
the adder circuit 358. Contrary, the quantization table decision drcuit 366 decides the quantization table Qn* for the 
h small blocks in this section (A© section in Rg. 1 0) if the output def Qp* - (RQ(n+i)o ■ RQn o) "S negative, and controls 

55 to select the terminal b of tiie switch 360. The latch circuit 362 latches again tiie output def Qn- and supplies it to 
the adder circuit 358, 

Next, RQ(nvi)i - RQn'i is read from FIFO 356 and outputted to the adder circuit 358. The adder circuit 358 
subtracts RQ(n+i)i - RQn'i ^om tiie output of the latch circuit 362, and supplies the result to the terminal a of the 
switch 360 and to the quantization table decision circuit 366. Similar to the above, the quantization table decision 
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circuit 366 decides the quantization table Qp +i for tiie h small blocks in this section (Ai section in Fig. 10) if the 
output of the adder circuit 358 is "0" or larger, and controls to select the terminal a of the switch 360. The latch circuit 
362 latches the output of the adder circuit. Contrary, the quantization table decision circuit 366 decides the quanti- 
zation table Qn* for the h small blocks in this section (Ai section in Fig. 10) if the output of the adder cii-cuit 358 is 

5 negative, and controls to select the terminal b of the switch 360. The latch circuit 362 latches again the output def Qn-. 

In the manner described above, quantization tables for the sections Aq. Ai...., A0^(h-i)) are sequentially decided. 
For example, if k = 30 and h = 6, quantization tables (Qn+i. Qn*. Qn+i. Qn+i. Qn*) decided for the sections (Ao. 
Ai. A2, A3, A4). The decided quantization table Is transmitted via a terminal 370. A FIFO 340 delays the orthogonally 
transformed image data by a time required for deciding the quantization table. 

10 (2) Next, the operation when the latch circuit 312 outputs "1" (high level, in excess of the target code amount Rk) 
will be d^cribed. 

At me start of processing the k small blocks as the length fixing unit, the latch circuit 350 is loaded with the target 
code amount Rk via the input terminal 314. When the code amount at the latch circuit 346 takes a value RQ(n*-i)o 

15 corresponding to the section Aq shown in Fig. 10. the adder circuit 348 calculates R^ - R(n*-1)0 ^nd supplies the result 
to the latch circuit 350 which latches the output Rk - R{n'-1)0 the adder circuit 348. When the code amount at the latch 
circuit 346 takes a value RQ{n -i)i con-esponding to the section A-i shown in Fig. 10, the adder circuit 348 subtracts the 
value RQ(n -i)i from the output Rk - R(n -1)0 0* 'atch circuit 350 and outputs Rk - R(n'-1)0 ■ RQ(n'-i)i to lafoh circuit 
350 which latches the output Rk - R(n*.i)o "RQ(n -i)i of the adder circuit 348. 

20 When the k small blocks are processed, the value latched by the latch circuit 350 is def 
O (nM) = R K - R (n-i)o " RQ (n-i)i '-'^ (n-i)(K/(h.2)) " « {nM)(k/(h-i)) • When the value def Q(nM) is obtained, the terminal 
a of the switch 364 is selected and the value def Q(n'.i) is loaded in the latch circuit 362. Similar to the example (1 ), the 

kAi values RQ(n-i)o - RQnO. RQ(n'-i)i ■ RQn'i RQ(n'-i)(k/(h-i)) " RQn'(k/(h-i)) ^re loaded in FIFO 356. 

In the example (1), the adder circuit 358 subtracts the value read from FIFO 356 from the output of the latch circuit 

25 362. However, in this example (2). the values loaded in FIFO, including the k^ values RQ(n-i)o - RQnO. RQ(n--i)i - 

RQ^n i) RQ(n-.i)(k/{h-i)) -RQn--(k/(h-i)). ^^e negative. Therefore, the adder circuit 358 adds the ou^DUt of the latch circuit 

362 to the output of FIFO 356. and the other operations thereof are similar to the example (1). In this manner, the 

quantization tables for the sections Aq. Ai Ak/(h.i) are decided. For exanrple. if k = 30 and h = 6. quantization tables 

(Qn\ Qn'. Qn-1. Qn'-1. Qn'-i) decided for the sections (Aq. Ai. A2. A3. A4). 

30 The quantization circuits 300. 338 select either the quantization table for the high definition image (HD) or the quan- 
tization tattle for the standard definition image (SD). in accordance with the high definition (HD) image mode signal or 
standard definition (SD) image mode signal supplied from the input terminal 104. 

As described above, according to this embodiment, the k small blocks as the length fixing unit are quantized by 
using the predicted quantization table, and the code amount is calculated. The image data is further quantized by using 

35 a quantization table having a step width smaller than another quantization table predicted by the difference from the 
target code amount or by using a quantization table having a larger step width. In this manner, the quantization table 
is decided so as to make the difference from the target code amount for the h (1 ^ h ^ k) small block unit as small as 
possible. Accordingly, less degraded and highly precise images can be formed. In addition, an overflow to be caused 
by a miss of prediction can be dealt with. 

40 This ©nbodiment can be realized also by the structure shown in Fig. 1 1 . The circuit shown in Fig. 1 1 removes the 
circuit of Fig. 9 connected between the terminals 124. 126. and 128 and the terminals 148. 208, and 156. The operation 
of ttiis circuit is similar to the above emtxxiiment. and so the description thereof is omitted. With this circuit, the amount 
of hardware can be reduced further. 

Rg. 12 is a block diagram showing the fourth embodiment of the invention. Elements having similar functions to 

4s those of the first to third entxxiiments are represented by identical reference numerals. Only different points from the 
first to third second emtxxliments will be described. 

Referring to Rg. 12, a sort circuit 500 sorts the values latched by the latch circuit 354 in the descending order of 
their absolute values. Assuming that k = 30 and h = 6 and the output of the latch ciroiit 31 2 is "0" (low level), the operation 
of this circuit will be desaibed. The sort circuit 500 sorts the values latched by the latched circuit 354, including the 

50 values RQ(n+i)o - ROn'o- RQ(n+i)i - RQn-1 RQ(n+i)4 " RQn'A' descending order of their absolute values, for 

example, into RQ(nvi)2 - RQn-2. RQ(nvi)o- RQn-o» RQ(nvi)3 ■ RQn-3. RQ(n +i)i - RQn'1. and RQ(nvi)4 - RQn*4- The value 
is read in the sorted order, first, the value RQ(n-+i)2 • ROn^g. and the processes similar to the third embodiment are 
performed. In this case, the quantization table decision circuit 502 receives sort information from the sort cirojit 500. 
and decides the quantization table in the order of the sections (A2, Ao, A3, Ai, A4) shown in Fig. 10. The operations of 

55 the sort circuit 500 and quantization table decision circuit 502 are basically similar also for the case wherein the output 
of the latch circuit 312 Is "1 " (high level), and so the description thereof is omitted. Similar to the third embodiment, this 
embodiment is also conrpatible both with the high definition (HD) and standard definition (SD) images. 

As descried above, according to the fourth embodiment, the k small blocks as the length fixing unit are quantized 
by using the predicted quantization table, and the code amount is calculated. The Image data is further quantized by 
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using a quantization table having a step width smaller than another quantization table predicted by the difference from 
the target code amount, or by using a quantization table having a larger step width. A difference from the code amount 
relative to the quantization table predicted by the h (1 ^ h ^ k) small block unit is calculated. The larger the absolute 
value of the difference, the larger the code amount is assigned so as to make the code amount near to the target code 
5 amount. Accordingly, less degraded and highly precise images can be formed. In addition, an overflow to be caused by 
a miss of prediction can be dealt with. 

This embodiment can be realized also by the structure shown in Fig. 13. The circuit shown in Fig. 13 removes the 
circuit of Fig. 1 2 connected between the terminals 1 24, 1 26, and 1 28 and the terminals 1 48, 208, and 1 56. The operation 
of this circuit is similar to the above embodiment, and so the description thereof is omitted. With this circuit, the amount 
10 of hardware can be reduced further. 

In this embodiment, the values RQn r (0 ^ r ^ k/(h-1)) inputted to FIFO 324 or the output values RQ(n +i)r or RQ(n'- 
of the latch circuit 346 may be sorted In the descending order and the quantization table is decided in this order. 
As described so far, the structures of the above embodiments provide a quantizer suitable for length fixing with a 
small amount of hardware and less degraded and high quality images can be formed. 
75 If the calculated code amount is the target code amount or smaller, the quantizer having a finer quantization step 
than the predicted quantizer is used. If the calculated code amount is in excess of the target code amount, the quantizer 
having a more coarse quantization step than the predicted quantizer is used. The two quantizers are adaptively selected 
in the length fixing unit (in k small blocks). In this manner, length fixing having a smaller difference from the target code 
amount can be performed and Images of higher quality can be formed. 

20 

Claims 

1 . A coding apparatus comprising: 

25 (a) means for obtaining a first code amount by coding inputted data by using a predetermined quantization table; 

(b) means for obtaining a second code amount in accordance with predetermined prediction data among a 
predetermined plurality set of prediction data; and 

(c) means for obtaining an optimum quantization table in accordance with a conrparison result between said 
first and second code amounts. 

30 

2. A coding apparatus according to claim 1 , wherein said inputted data is suppli^ in a unit of a block having a prede- 
termined number of pixels. 

3. A coding apparatus according to claim 2, wherein said first code amount is a code amount for n blocks. 

35 

4. A coding apparatus according to claim 1 , further connprising: 

(e) means for obtaining a third code amount through coding by using said optimum quantization table; 

(f) means for obtaining a fourth code amount in accordance with said prediction data; and 

40 (g) means for obtaining an optimum quantization table in accordance with a comparison result between said 

third and fourth code amounts. 

5. A coding apparatus according to claim 1 . wherein said plurality set of predication data are selected in accordance 
with the type of said inputted data. 

45 

6. A coding apparatus according to claim 5. wherein the type of said inputted data includes high definition (HD) image 
data and standard definition (SD) image data. 

7. A coding method comprising the steps of 

50 

(a) obtaining a first code amount by coding inputted data using a predetermined quantization table; 

(b) obtaining a second code amount in accordance with predetermined predication data among a predetermined 
plurality of sets of predication data; and 

(c) obtaining an optimum quantization table in accordance with a comparison result between said first and 
55 second code amounts. 

8. A signal coded in accordance with the method of claim 7. 

9. A signal coded using the coding apparatus of any one of claims 1 to 6. 
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